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A GENERALIZATION OF THE FOURIER COSINE SERIES* 



J. L. WALSH 

It is well known that on the interval ^ a; ^ x large classes of functions 
arbitrary except for certain restrictions as to oscillation or as to continuity 
and the existence and continuity of derivatives or as to some similar property 
can be developed into series in terms of the functions {cos nx}. The series 
are of the type 

(1) f{x)=-^ + (ii cos X + tti COS 2x + ■ • • , 

where any coefficient a„ may be obtained by the formal process of multiplying 
equation (1) through by cos nxdx and integrating term by term: 



2 C" 
a„ = — I / ( a; ) cos nxdx . 
^ Jo 



The present paper considers the problem of developing arbitrary functions 
throughout the same interval in terms of the second set of functions {cos X„ .t} , 
where X„ is very near to n . Under suitable restrictions it is proved that the 
two developments have essentially the same convergence properties.! We 



* Presented to the Society, September, 1920. 

t This study was undertaken at the suggestion of Professor Birkhoff, who proposed an 
analogous generalization of the Fourier sine series. There is no analogous generalization of 
the sine series such that developments in terms of the two sets of functions (sin na;) and 
{sin X„ a; } , where An is near but not equal to n , will have the same convergence properties on 
the interval ^ a; ^ ir . For at the right-hand end of the interval any particular function 
sin X/i X is not zero and hence cannot be developed in a uniformly convergent series in terms of 
jsin «a;) , but it can be developed in a uniformly convergent series in terms of [sin X„x) . 
Thus the methods of the present paper cannot be used to give a generaUzation of the sine series 
on the interval ^x ^ tt, but these methods with sUght modifications would enable us to 
replace the set (sin nx] by a set {sin Xnx} such that developments in terms of the two sets 
of functions will have the same convergence properties on the interval ^ a; ^ tt — « , where 
e is arbitrary. 

The methods used in this paper are in spirit closely related to the methods used by Birk- 
hoff, Paris Comptes Rendus, vol. 164 (1917), pp. 942-945, who gives a similar 
generalization of Taylor's series. Birkhoff makes use of the theory of integral equations, but 
the related theory of infinitely many variables as used in the present paper leads to more 
general results. 
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shall say that two series 

00 00 

i=l 1 = 1 

have essentially the same convergence properties when and only when the 
series 

PC 

X ( «i Ui — hiUi) 

1=1 

converges absolutely and uniformly to the sum zero. 
The set of functions 

12 2 „ 

— , — cos X , — cos 2x, • • • 

IT IT W 

is a normal and orthogonal set on the interval = a; = tt . Any set of func- 
tions {un] continuous on a finite interval is said to be normal and orthogonal 
on that interval if and only if 



/ 



Ui Uj dx = dij {i,j = 1,2,3, • • • ); 



here and throughout this paper dij is the Kronecker symbol which is unity 
or zero according as i and j are or are not equal. In this integral and below 
we omit the argument, which is x in every case, and also omit the limits of 
integration, which are the ends of the interval considered. We shall prove 
that corresponding to the set of functions 

1 2 2 

— cos Xo a; , — cos Xi a; , — cos X2 .t , • • • 

IT IT TT 

there is another set of functions such that the two sets are biorthogonal for 
S a; ^ TT. Two sets of continuous functions {Un} and {»„} are biorthogonal 
on an interval if and only if 



/ 



Ui Vj dx = bij (», i = 1 , 2 , • • • ) • 



We shall prove a general theorem concerning the generalization of expansions 
in terms of any uniformly bounded normal orthogonal set [un], by considering 
a set [un] where m„ is a function neighboring to m„. Briefly described, the 
method is to expand the t<„ into series in terms of the m„ , to invert the corre- 
sponding system of equations and expand the Un in terms of the m„, and 
finally to substitute the latter series into the expansion of the arbitrary func- 
tion in terms of the Un ■ This gives the expansion of / ( a; ) in terms of the Un ■ 
The form of presentation of the material is slightly changed by the intro- 
duction of a set of functions {vn} such that {««} and {»„} are biorthogonal sets. 
The various steps in the proof will seem much less artificial if the general 
method is kept in mind. 
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After the general theorem is proved, application is made to the cosine 
series. We add that the method seems to be of very wide applicability; it is 
hoped later to give further applications to the Sturm-Liouville and other series 
developments. Throughout the present paper there is more regard for sim- 
plicity than for ultimate generality. 

I. A GENERAL THEOREM 

Theorem I. Suppose that {un] is a set of uniformly bounded normal ortho- 
gonal functions in an interval, and that in this interval {«„} is a set of uniformly 
bounded continuous functions each of which can be developed into a series 

00 

(2) Un = J2iCnk + ^nk)ilk {n = 1 , 2 , • ■ ■ ) , 

k=l 

where the coefficients have the values 

(3) Cnk -\- Kk = I Un Uk dx . 

Suppose further that the three series 

CO 00 / CO \ ^ X / 00 \ ^ 

(4) i:ci.,j:(Zci),T,(j:ch) 

i,k=\ i=l \k=\ / *=1 \ i=l / 

converge and that the value of the first is less than unity. 

Then there exists a set of functions {vi} si/chthat {m,} and {vi} are hiorthogonal 
sets: 

(5) ( UiVjdx = dij {i,j = 1,2, •••)• 

Furthermore, if f {x) is any function integrahle and with an integrable square (in 
the sense of Lebesgue), then the two series 

00 

(6) / ( a; ) ~ X) «» ^i , 

i=l 

00 

(7) f{x) ^Y.biUi, 

i=l 

where 

ai = \ fui dx , 

(8) 

bi = j fvi dx , 

have essentially the same convergence properties. 
The sign ~ is used simply to indicate that the coefficients Oj and bi are given 
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by (8). We shall give later some of the more immediate consequences of the 
fact that (6) and (7) have essentially the same convergence properties. 

To prepare for the inversion of system (2), which is an important step in 
the proof of Theorem I, we shall use the following 

Lemma: If for the system 

( 1 + cii ) a;i + Ci2 X'i + Ci3 a;3 + • • • = Ci , 

J.QN C21 a;i + ( 1 + C22 )xi + C23 3:3 + • • • = C2 , 

C31 a;i + C32 X2 + ( 1 + C33 ) a;3 + • • • = C3 , 

the series 





00 








QO 




y 




0?, 


f 


__ 


.5, 


A, 



converge, and if p^ < 1 , then the system has one solution {xi} and only one 
solution for which 

00 

/ ' Xi 

i=l 

converges* 

The lemma is proved bj^ the method of successive approximations, setting 

X'P = Ci- [Cii.T</' + Ci2Xg'+ •••], 

.t<"+" = Ci - [ca x'r' + Ci2 x<i^ +■■■], 
From the well-known inequality 
(10) Zla./3.| ^ ZaH (Jl^l) 

k=l \k=l / \k=l / 

(which holds for all sets of numbers {a*;} and {^k}) and from the convergence 
of the series whose sums are denoted by 7^ and p^ , it follows that the series 

Xi = X'P + UP - xT) + ixf - X?) + ■■■ (^ = 1 , 2, • • • ) 

are all absolutely convergent and that the system {xi} as thus defined is a 

* This lemma is included implicitly in some results of Hilb, Sitzungsberichte 
der Physikalisch-medizinischen Sozietat in Erlangen, vol. 40 
(1908), pp. 1-6. Hilb makes use of the theory of bilinear forms in infinitely many variables, 
so that his proof differs in form (but not in substance) from the proof here presented. We 
indicate the proof because of its simplicity and because we shall use later the inequalities 
obtained in the course of the proof. 
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solution of (9). If we introduce the notation pf = ^'j=icjj, it is readily 
proved by further use of the same inequality that 

Xi Ci 



1-p' 
(11) 

The series ^|Li a;! converges, for we obtain the relations* 

I Xi I = I Xi Ci j ~t" 1 Cj I , 

T,x't^f:i\xi-Ci\ + \ci\y;=k2f:(xi-Ciy + 2T,cl. 

1=1 1=1 »=1 i=l 

There is no other solution of system (9) such that ^»^i xf converges. For if 
there were, we should have a solution {yi} of the homogeneous system cor- 
responding to (9) and such that the series 

p = 1:2/1 

i=l 

converges. In the kth. equation of the homogeneous system, if we transpose yk 
to the right-hand member, we obtain 

yl^Y'pl, 

and hence we also have 

k=l 

In this same manner we have 

^yl^Y'p'% 
*=1 

where n is any positive integer, and hence yk = (k = 1 , 2 , • • •) . 

We apply this lemma (the proof of which is now complete) to determine the 
set of functions {vk} of Theorem I. Let us assume a development of the type 

00 /» 

(12) Vk = '^ (dki + dki)ui, where dki + Ski = ( VkUidx. 

The condition that the Vk have the desired property (5) is given formally 
from the developments (2) and (12) by the conditions 

(13) Cki + dik + Cki dii + Cki. dii + Ckz diz + • • • =0 

for every i and k. When i is kept fixed, this is precisely system (9); the 
* By use of the inequality 

(a+^)2<2(a2+^). 



1921] GENERALIZATION OF FOURIER COSINE SERIES 235 

conditions of the lemma are fulfilled by virtue of the hypothesis of Theorem I, 
and therefore there exists a solution ( dn , da , da, •••)>* with the properties 
stated in the lemma. If we choose that solution and use inequalities (11) and 
the convergence of series (4), we actually arrive at a system of continuous 
functions [vk] which satisfy (5) and are given by (12) and (13). 

Our preparation for the inversion of system (2) is nearly complete. We 
introduce the notation 

(14) eik = Cki + dik + cu dik + ca d^k + Czi du + • • • 

and shall prove e,j; = for every i and k . In the set of equations 

ea = Cu + dn + Cu dn + Cu du + Cs,- dzi -\- • ■ • , 

fa = Cu + dii + Cu dn + cu d^ + c^ dzt -\- ■ ■ • , 

«i3 = csi + da + cu dw + cii diz + czi cZss + • • • , 

multiply the ith equation by Cni and sum by columns, making use of (13) 
and (14). We obtain the result 

Ck\ in + Cfc2 «s2 + Ck3 iiZ -\- • ' • = — iik ■ 

The formal work is readily justified by the convergence of series (4). More- 
over, the series ^"=1 efi converges, from the definition (14) and from (11) 
applied to the set ( dn , dn , diz, • • • ) as a solution of (13), so the set ( m , en , 
e,3 , • • • ) forms a solution of the homogeneous system corresponding to (9) 
and hence eik = for every i and h . 

We are now in a position to invert system (2). We write the equations 

Ck\ + dik + Cu dik + C21 dik + czidzk -\- • • • =0, 
Cki + dik + C12 dik + C22 dik + C32 c?3fc + • • • = , 
Ckz + dzk + Cia dik + C23 (?2fc + C33 rfa* + • • • = , 



multiply the ith. equation by Wf and sum by columns. Justification of the 
formal work is immediate, and we obtain the desired developments 

Uk — Ilk = J^diklli (k = 1,2,3, ■■■). 

Let us suppose, now, f(x) to be any function integrable and with an inte- 
grable square in the sense of Lebesgue. We find the coefficients (8) by multi- 

* For a non-vanishing finite determinant, the numbers dik + Sik are the quotients of the 
cofactors of the c,* + Sik by the value of the determinant. 
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plying (12) through by /(a;) and integrating term by term. This yields the 

result 

(15) bk - Ok = dki ffli + dk2 a2 + dkzaz-\- ■■• .* 

The difference of the series (6) and (7) may be written 

00 00 00 

X) ( a,- Mi — biUi) =22 «»■ {ui — Ui) +^{ tti — hi ) Mi 
(16) 

00 / °° \ 00 / 00 \ 

= — 2 a.- 1 ZI Cij My ) — H ( (^ii ai + (^i2 a2 + • • • ) ( ^» + Z) Ciy % ) , 

which series converges absolutely and uniformly and has the sum zero. We 
make use of the convergence of the series Zf=i al , which may be proved easily 
from the relation 



h^ 



(17) I (/ — ai Ml — a2 M2 — • • • — «n Mr. )^ (^a; g . 

Hence, series (6) and (7) have the same convergence properties, in the sense 
that (16) converges absolutely and uniformly to zero. It follows immediately 
that properties of absolute convergence, convergence, summability, and 
divergence obtain for one series as for the other, and likewise the properties of 
uniform convergence in the entire interval considered or in any sub-interval, 
uniform summability, and also of term-by-term integrability. Whenever 
the two series (6) and (7) are convergent, summable, or properly divergent, 
their sums are the same. The nature of the approximating functions and of 
their approach to the limit (in case of convergence) at a point of continuity 
or of discontinuity oi f{x) is essentially the same for (6) as for (7). In par- 
ticular if Gibbs's phenomenon occurs for (6) it also occurs for (7) . The reader 
will notice various other properties common to the sets {Mi} and {«»} , such as 
the existence or non-existence of a continuous function for which the formal 
series does not converge at every point. 

The conditions of Theorem I concerned with the series (4) can be made 
* If we use the convergence of Sf_i of , which is proved from (17); if we write the equations 

bi — ai = dn ai + dn 02 + dis as + • • • , 

62 — 02 = ^21 fli + d22 "2 + ^23 as + • • • , 

bz — as = dsi ai + dzi 02 + dzs az + •• ■ , 



multiply the ith equation by ca- , and sum by columns, we obtain 

flit — bic = Cih bi + C2k b2 + Czhbz + • ■ ■ . 

Hence if the {6; j are all zero, so are all the {ai } . The converse is evident from (15). 

We also add that if the series 2"_i | at \ converges, so does the series Sf_j \bi\, and conversely. 
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more restrictive so that the convergence properties of (6) and (7) will be essen- 
tially the same for all functions absolutely integrable in the sense of Lebesque, 
or on the other hand can be made less restrictive and still yield a result say 
for functions such that the series of absolute values of the coefficients ^"=1 1 a,- 1 
converges. 

We add the remark that the relation between the {ui} and the {vi} is essen- 
tially reciprocal — we may obtain corresponding results for expansions in 
terms of the {lu}. Theorem I is readily extended, moreover, by taking as 
point of departure developments in terms of functions {ui] which are not 
supposed orthogonal. 

II. Application to the Fourier cosine series 

For the interval S a; ^ tt , we have mentioned the normal orthogonal 
system of uniformly bounded continuous functions 

12 2 2 

(18) — , — cos X , — cos 2x , — cos 3.t , • • • . 

TT TT TT TT 

Application of Theorem I will yield the following theorem. 

Theorem II. The expansion of any function f {x) integrable and with an 
integrable square in terms of the functions 

12 2 2 

— cos Xo a; , — cos Xi .t , — cos X2 x , — cos X3 a* , • • • 

TT TT TT TT 

on the interval = a; = tt , ichere 

(19) XS + 4(Xi - 1)2 + 4 (X2 -2)2-^4 (X3- 3)2 -F ••• <- 

TT 

and tchere 

(20) %A\n-n\ 

converges, has essentially the same convergence properties as the expansion of f{x) 
in terms of the functions (18). 

It is of course true that our set of functions {um} can be developed in terms 
of the functions {um], so it merely remains to prove the convergence of the 
series (4) and that the value of the first of these series is less than unity. 

Inequality (17) gives us the relation 

ScL. = \ {Um — Um)' dx (m = 1 , 2 , 3 , • • • ) , 

and in the present case if m =t= 1 and if we replace m by n + 1 , this integral 
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becomes 

4 f" 

-2 I ( COS X„ X — cos nx )- dx 

(21) "" -^^ 

= — 5 I [4 sin^ ^ (X„ + w ) a; • sin^ |(Xn — n ) a; ] rf.T . 

T' Jo 

But we always have the relation | sin a | S | a | , and hence we obtain 

00 

2]cf+i,iS47r(X„ -nf (n = l,2,3, •••)• 

If we omit the factor 4 from the right-hand member we obtain the proper 
formula for w = 0. Satisfaction of (19) therefore means that we have satis- 
fied the following requirement of Theorem I 

CO 

2 cL < 1 . 

It remains to be shown that the last two series in (4) converge. From the 
formula 

4 r 

(22) Cn+\, t+1 = ~i I (cos X„ X — COS nx) cos kxdx 

TT Jo 

(« = 1,2, • 

integration by parts twice yields the formula 



(23) 



I COS kx I "" 

-c„+i, i+i = — (X„ sin \nX — n sin nx) — p-^ 



cos fcr , 
ax . 



-\- \ ( Xl cos X„ X — n^ cos nx ) ,^ 

To deal with this integral, we write 

(24) X^ cos "KnX — n^ cos nx = { Xf. — n^) cos X„ x + n^ { cos X„ a; — cos nx ) . 

If ri > 2, we find with the aid of (19) the obvious relation 

|X„ + nl <2n + 2 <n\ 
whence 

|Xl — ri^l < ra^|X„ — n| ; 

we use this inequality in considering the first term of the right-hand member 
of (24). The last term of the right-hand member of (24) can be transformed 
as in (21), and its absolute value is therefore not greater than Ji^ 7r|X„ — n\. 
The first term in the right-hand member of (23) with the factor cos A'tt/P 
omitted, reduces to X„ ( sin X„ tt — sin rnr ) . When n > 1 , we have |Xn | = n- , 
and therefore 

I X„ ( sin X„ X — sin riTT ) I ^ n^ x | Xn — m | . 
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From these inequalities for the absolute value of the right-hand member of 
(23) and from the corresponding results for k = and n = 2 we prove the 
convergence of 

CO 

y \c J 

/ ' I <^nfc I 
n, k=l 

by means of the convergence of (20) and hence* prove the convergence of the 
last two series of (4) and complete the proof of Theorem II. 

We add the remark that a closer evaluation of c„k , and also the consideration 
of functions m„ = Hn cos Xn x where ;u„ is properly determined, will give 
broader restrictions than (19) and (20). 

Harvard University, 
May, 1920 



' Here we make use of the inequality 



i — l 



[(,|i«ir^[,i-]* 



